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ON CONFORMAL QC GEOMETRY, SPHERICAL QC MANIFOLDS AND 
CONVEX COCOMPACT SUBGROUPS OF Sp(n + 1,1) 

YUN SHI AND WEI WANG 

Abstract. Conformal qc geometry of spherical qc manifolds are investigated. We construct 
the qc Yamabe operators on qc manifolds, which are covariant under the conformal qc trans¬ 
formations. A qc manifold is scalar positive, negative or vanishing if and only if its qc Yamabe 
invariant is positive, negative or zero, respectively. On a scalar positive spherical qc manifold, 
we can construct the Green function of the qc Yamabe operator, which can be applied to con¬ 
struct a conformally invariant tensor. It becomes a spherical qc metric if the qc positive mass 
conjecture is true. Gonformal qc geometry of spherical qc manifolds can be applied to study 
convex cocompact subgroups of Sp(n-|- 1,1). On a spherical qc manifold constructed from such 
a discrete subgroup, we construct a spherical qc metric of Nayatani type. As a corollary, we 
prove that such a spherical qc manifold is scalar positive, negative or vanishing if and only if 
the Poincare critical exponent of the discrete subgroup is less than, greater than or equal to 
2n + 2, respectively. 
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1. Introduction 

A locally conformally flat manifold is a Riemannian manifold which is locally conformally 
equivalent to the Euclidean space. Its complex counterpart is the spherical CR manifold, which is 
a pseudohermitian manifold locally conformally equivalent to the Heisenberg group. A conformal 
class of the locally conformally flat manifolds (or spherical CR manifolds) can be described as 
a manifold whose coordinate charts are given by open subsets of the Euclidean space (or the 
Heisenberg group) and elements of SO(n + 1,1) (or SU(re + 1,1)) as transition maps. In this 
paper, we will investigate their quaternionic counterpart: the spherical qc manifolds. 

The notion of a qc manifold was introduced by Biquard [3] as the quaternionic counterpart 
of the notion of a pseudohermitian manifold in the CR geometry. A qc manifold is denoted by 
{AI,g,Q), where M is a (4n + 3)-dimensional manifold, g is the Carnot-Caratheodory metric on 
a codimension three distribution H and Q is a rank-three bundle of quaternionic structures. As 
the Tanaka-Webster connection in the CR geometry, the Biquard connection is the canonical 
connection for qc manifolds [3]. {M,g,Q) is said to be conformal to {M,g,Q), g = (pg for 
some positive function p. A qc manifold (M, g, Q) is called spherical if it is locally conformally 
qc equivalent to an open set of the quaternionic Heisenberg group. We are interested in the 
conformal classes of spherical qc manifolds. A conformal class can be described as a manifold 
whose coordinate charts are given by open subsets of the quaternionic Heisenberg group and 
elements of Sp(n-|-1,1) as transition maps. This is a topological description of a conformal class 
of spherical qc manifolds. The purpose of this paper is to investigate conformal qc geometry for 
spherical qc manifolds. 

Spherical qc manifolds are abundant. We can construct spherical qc manifolds by taking 
connected sums. The connected sum of two spherical qc manifolds is constructed as follows 
(cf. § 2.5). Suppose that and M( 2 ) are two spherical qc manifolds with one puncture 

r]i G = 1,2, each. Let Ui and U 2 be neighborhoods of rji and 7 ^ 2 , respectively. Now 

identify Ui with the ball of quaternionic Heisenberg group with radius 2, centered at origin. We 
remove the closed balls with radius t < \. Let [/j(t, 1), i = 1,2, be corresponding rings with 
inner radius t and outer radius 1. There exist conformal qc transformations mapping 
to U 2 {t, 1), which identify the inner boundary of Ui{t, 1) with the outer boundary U 2 {t, 1) and 
vise versa. We glue Mi and M 2 by such a transformation to get a new spherical qc manifold. 

As in the locally conformally flat case and the spherical CR case, convex cocompact subgroups 
of Sp(n -|- 1,1) provide lots of examples of spherical qc manifolds. Sp(n -|- 1,1) acts isometrically 
on the nnit ball of the (n -|- l)-dimensional quaternionic space, when the ball is equipped 

with the quaternionic hyperbolic metric. Also Sp(n-|-1,1) acts conformally on its boundary, the 
sphere with the standard qc metric. Let T be a convex cocompact subgroup of Sp(n-|-1,1). 

The limit set of T is 

A(r) = 

for q G where Tg is the closure of the orbit of q under T, and 

n(r) = 5^’"+3\A(r) 
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is the maximal open set where F acts discontinuously. It is known that II(r)/r is a compact 
spherical qc manifold when F is a convex cocompact subgroup of Sp(n + 1,1). Modelled on 
the theory of Riemann surfaces, the basic problems for locally conformally flat manifolds are 
their classification and the moduli space. It is so for spherical CR manifolds and spherical qc 
manifolds. It is well known that each compact Riemann surface has a metric with constant 
curvature, which only depends on the conformal class of Riemann surfaces. This invariant 
metric was generalized by Habermann-Jost m m to the locally conformally flat case. They 
constructed a canonical metric on each scalar positive locally conformally flat manifold, which 
only depends on the conformal class of such manifolds. This construction was generalized to the 
spherical CR case by the second author [33] . 

The uniformization problem is to show each scalar positive spherical qc manifold can be 
constructed from some convex cocompact subgroup of Sp(n + 1,1). The problem was solved in 
|32| for locally conformally flat manifolds and in |3] for spherical CR manifolds. See [2D| and 
[35] for discussion of their moduli spaces. 

In Section 2, we recall the definitions of a qc manifold, the Biquard connection and the ball 
model of the quaternionic hyperbolic space. For our purpose later, we describe explicitly the 
flat qc structure on the quaternionic Heisenberg group and the standard spherical qc metric on 
the sphere. The group Sp(n + 1,1) is the group of all (n + 2) x (n + 2) quaternionic matrices 
which preserve the following hyperhermitian form: 

(FI) Q{q,P) = -qiPl - Qn+lPn+l + qn+2pn+2, 

where q = (gi, • • • ,qn+ 2 )i P = (pic '' )Pn+ 2 ) £ In this paper we only consider left 

quaternionic vector spaces. So a matrix acts on a vector from right. Sp(n+1,1) acts isometrically 
on the ball model of the quaternionic hyperbolic space and conformally on the sphere with the 
standard qc structure. We write down such a conformal action explicitly by calculating the 
conformal factor in terms of matrix elements of an element of Sp(n + 1,1). We also show 
that a qc manifold (M, g, Q) is spherical if and only if it is a manifold with coordinates charts 
{{Ui,4>i)}, where (j)i : Ui ^ transition maps are given by the induced action of 

elements of Sp(n + 1,1). 

Since topologically defined spherical qc manifolds depends on the conformal class of qc met¬ 
rics, we need to study conformal qc geometry. In particular, we are interested in constructing 
conformal invariants. We will construct conformally covariant operators, since some quantity 
associated to such a operator will provide us a conformal invariant. In this way we can ob¬ 
tain invariants for topologically defined spherical qc manifolds. Given a qc manifold {M,g,Q), 
let be the SubLaplacian operator and let Sg^Q be its scalar curvature. In Section 3, we 

construct the qc Yamabe operator 

- ^nAgi^Q -|- Sg^Q, 

where bn = 4^^, and Q = 4n -|- 6 is the homogeneous dimension of M. This is a conformally 
covariant operator. Namely, under the conformal change 

( 1 . 2 ) g = cj)Q^g^ 

it satisfies the following transformation law 
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for any smooth real function /. Denote by •) the Green function of the qc Yamabe 

operator with the pole at i.e. 

■) ~ 

where is the Dirac function at the point 

As in the Riemannian case [32] and the CR case [33], we will see that for a connected com¬ 
pact qc manifold {M,g,Q), one and only one of the following cases holds: there is a qc metric 
g conformal to g which have either positive, negative or zero scalar curvature everywhere. The 
manifold is called scalar positive, scalar negative or scalar vanishing respectively. This is equiv¬ 
alent to its first eigenvalue of the qc Yamabe operator or the qc Yamabe invariant is positive, 
negative or zero, respectively. This is a property of conformal classes. On a scalar positive 
spherical qc manifold, the Green function of the qc Yamabe operator Lg^Q always exists, and 

(1-3) PgMit V) = ■ ll^-irJyQ-2’ ^ 

is its singular part, if we identify a neighborhood of ^ with an open set of the quaternionic 

4 

Heisenberg group with the qc metric g = (j)^-^gQ. Here go is the standard qc metric on the 
quaternionic Heisenberg group || • || is the norm on the quaternionic Heisenberg group and 
Cq is a positive constant (13.120 . Moreover the limit 

(1.4) = limJG'g.Q(?,??) 


of the nonsingular part of the Green function exists, and Qg is conformal invariant, i.e. 




= Ai 


under the conformal transformation (ra . We also prove the transformation law of Green 
functions under the conformal change m-- 


Gg,Q{C,P) 


1 




As in the conformal geometry and the CR geometry, we propose the following positive mass 
conjecture. 

The qc positive mass conjecture: Let (M, g, Q) be a compact scalar positive spherical qc 
manifold with dimM = 4n -|- 3. Then, 

1. For each ^ G M, there exists a local qc diffeomorphism G^ from a neighborhood of f to the 
quaternionic Heisenberg group such that C|(^) = oo and 


where 

Hv) = 1+A,Q«)ii'7r®+" + o(ii,ir«+'), 

near oo, and go is the standard qc metric on Ag^Q{(^) is called the qc mass at the point f. 
2. is nonnegative and is zero if and only if {M,g,Q) is qc equivalent to the standard 

sphere. 

Li gave the statement of the CR positive mass theorem in [25]. A complete proof of CR 
positive mass theorem was given by Cheng, Chiu and Yang in [3| recently. 

This conjecture implies that Ag^q is non-vanishing, so Ag qP is a conformally invariant qc 
metric. By estimating the qc Yamabe invariant of the connected sum, we prove that some 
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connected sum of two scalar positive spherical qc manifolds is also scalar positive. So scalar 
positive spherical qc manifolds are abundant. 

In Section 5, we recall the definitions of the convex cocompact subgroups of Sp(n + 1,1) and 
the Patterson-Sullivan measure. The Poincare critical exponent 5(r) of a discrete subgroup T 
is defined as 

(I(r) = inf I s > 0 ; ^ (,-y-d{pMq)) < oo | , 

where p and q are two points in the ball and d{-, •) is the quaternionic hyperbolic distance 

on ij 4 n +4 independent of the particular choice of points p and q. Fix a point q € 

the series 

7 er 

converges for s > (i(r) and any p G ^ 4 n+ 4 ^ diverges for any s < 5(r). For any convex 
cocompact subgroup F of Sp(n + 1,1), there exists a probability measure /ir supported on its 
limit set A(r), called the Patterson-Sullivan measure, such that 

1* l^T = 


for any 7 G F (cf. [ 6 ]), where ly'l is the conformal factor. 

The conformal qc geometry of spherical qc manifolds can be applied to study convex cocom¬ 
pact subgroups of Sp(re -|- 1,1). Let Gs{^, •) be the Green function of the qc Yamabe operator 
with the pole at ^ on the standard sphere In Section 6 , by integrating Green function 

with respect to the Patterson-Sullivan measure, we define a C°° function on the open set II(r) : 

m)= ([ Gu^,c)dMc) 


2^(r) 

Q-2' 


Then ^ 

gr = (Pr~^g 

is invariant under F, and so defines a metric on II(r)/F. This is the qc generalization of Nay- 
atani’s canonical metric in conformal geometry [26]. We prove that if (5(r) < 2n 2 (resp. 
(5(r) > 2 n -|- 2 , resp. 5(r) = 2 n -|- 2 ), then the scalar curvature of (n(F)/r, gr, Q) is positive 
(resp. negative, resp. zero) everywhere. This result was proved for locally conformally flat 
manifolds by Nayatani [26|. For spherical CR manifolds it was proved by Nayatani m and 
Wang |33| independently. 

In the Appendix, we give a simple proof of the Green function of the qc Yamabe operator on 
the quaternionic Heisenberg group. 


2 . Qc MANIFOLDS 

2.1. Qc manifolds. A quaternionic contact (qc) manifold (M,g,Q) is a (4n-|-3)-dimensional 
manifold M with a codimension three distribution H locally given as the kernel of a M^-valued 
1-form 0 = ( 01 , 02 ,^ 3 ), on which g is a Carnot-Caratheodory metric. In addition, H has an 
Sp(n)Sp(l)-structure, that is, it is equipped with a rank-three bundle 

Q = {all 6/2 + cl^la'^ = 1}, 
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which consists of endomorphisms of H locally generated by three almost complex structures 
/i,/ 2,/3 on H satisfying the commutating relation of quaternions: 

(2.1) hh = -hh = h, If = If = If = -id\H- 

They are hermitian compatible with the metric: 

( 2 . 2 ) g{Is;Is-)=9i;-), 

and satisfy the compatibility condition 

(2.3) g{IsX,Y) = des{X,Y), 
for any X,Y & H, s = 1,2, 3. We denote I := {Ii, 12 , 13 ). 

4 

We say {M,g,Q) is conformal to {M,g,Q) if g = (j)Q-'^g for some smooth positive function 
(j) on M. The conformal class of qc manifolds is denoted by (M, [g'],Q). In the definition of qc 
manifolds, the valued 1-form 0 is unique up to a rotation by the following lemma. 

Lemma 2.1. (cf. p. 100 in [15]) Let {M,g,Q) be a qe manifold. If Q and Q' are two compatible 
M?-valued 1-form such that Ker(0) = Ker(0') = H locally, then we have Q' = ^0 for some 
T G SO{3)-valued smooth functions T. 

Proof. Write 0 = { 01 , 02 , 03 ) and 0' = { 0 'i, 02 , 03 ). The condition Ker(0) = Ker(0') = H 
implies that 'IlstOt for some GL(3)-valued function (T^t). Applying the exterior de¬ 

rivative, we find that dO'g = Ylt=i{d'^st L0t + ^stdOt), which restricted to H gives g{I'gX,Y) = 
Ylt=i ^stg{ItX,Y) for any X,Y £ H. Consequently we have 

3 

(2.4) = 

t=i 

So we must have ('I'st) G SO(3). □ 

Given a qc manifold {M,g,Q), there exists a canonical connection defined by Biquard in 
|3] when dimM > 7, and by Duchemin in [7| for the 7-dimensional case. It is called Biquard 
connection now. 

Theorem 2.1. (cf. §2.1.A. in [3j) If , g,Q) (for dimM >7) has a qc structure and g is 

a Carnot-caratheodory metric on H, then there exists a unique connection V on H and a unique 
supplementary subspace V of H in TM, sueh that 

(i) X preserves the decomposition H (BV and the metric; 

(ii) for X,Y G H, one has Tx,y = —[X,Y]y; 

(Hi) V preserves the Sp(n)Sp(l)-structure on H; 

(iv) for RgV, the endomorphism ■ —>■ {Tji^ )H of H lies in the orthogonal o/sp„0spi; 

(v) the eonnection on V is induced by the natural identification of V with the subspace sp;^ of 
the endomorphisms of H. 

A mapping F : {M,g,Q) —>■ {M,g,Q) is called a conformal qc mapping if 

(2.5) F*g = rg, F*Q = Q, 

for some positive function (j). The pull back F*A of an endomorphism A of 77 is defined as 

(2.6) F*A{X) := [A{F^X)] 
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for any X G i7. If F is invertible and F and F~^ are both qc mappings, F is called a qc 
diffeomorphism. If / is a qc diffeomorphism, we must have = H, where H and H are 
horizontal subbundles of TM and TM, respectively. 

2.2. The quaternionic Heisenberg group. The simplest qc manifold is the quaternionic 
Heisenberg group = H" 0 ImH, whose multiplication is given by 

{y, t) ■ (y', t') = {y + y'^t + t' + 2lra{yy')), 

where y, y' G H”' and t = tii + t 2 j + t' = t = t'ii + + t^k G ImH. The conjugation of a 

quaternion number xi + X 2 i + xsj T X 4 k is xi — X 2 i — xsj — X 4 k. The neutral element is (0,0) and 
the inverse of (y,t) is (—y, —t). The norm of the quaternionic Heisenberg group is dehned 
by 

(2.7) ||(y,t)||:=(|y|4 + |t|2)i. 

We have the following automorphisms of 

(1) dilations: 

( 2 . 8 ) Ds:{y,t)^{Sy,Sh), 6>0; 

(2) left translations: 

(2.9) r(y/^t/) : (y,t) —^ (y',f') • (y,f); 

(3) rotations: 

(2.10) U : {y,t) —^ {yU,t), for U G Sp(n), 
where 

(2.11) Sp(n) = {t/G GL(n,H)|[/i7‘= In}; 

(4) The inversion: 

(2.12) ii: (y,t) ^ (^-(|y|2-t)-iy,^^^^^ ; 


(5) Sp(l) acts on as; 

(2.13) cr:{y,t)—> {ay,ata~^), 

where the action on the first factor is left multiplication by o" G H with |cj| = 1, while the action 
on the second factor is isomorphism with SO(3). 

Note that for x = xi+ X 21 + xaj T X 4 k and x' = x( T X 2 i + x^ T X 4 k, we have 

Im(xx') = Im{(xi 0 X 2 i + xsj + X4k)(x4 — X 2 i — x^ — X 4 k)} 

= (-X1X2 + X 2 x '4 - X3X4 0 X4X3)i 0 (-X1X3 0 x^x'i 0 X2X4 - X4X2)j 

4 

0 (-X1X4 0 X4X4 - X2X3 0 X3X2)k =: ^ bljXkx'jis 

k,j=l 


(2.14) 
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(cf. (2.15) in [36]), where is the (/c,j)-th entry of the following matrices : 



( ° 

-1 

0 

0 



( ° 

0 

-1 

0 \ 

b ^-.= 

1 

0 

0 

0 


, b ^:= 

0 

0 

0 

1 


0 

0 

0 

-1 



1 

0 

0 

0 


V 0 

0 

1 

0 

) 


V 0 

-1 

0 

0 / 


( ° 

0 

0 

-1 

\ 





b ^: = 

0 

0 

-1 

0 







0 

1 

0 

0 







V 1 

0 

0 

0 

) 






It is easy to see that matrices b^,b^,b^ satisfy the commutating relation of quaternions; 
(2.16) {b^f = (6^)2 = (63)2 ^ ^ 


By ()2.14p . the multiplication of the quaternionic Heisenberg group in terms of real variables can 
written as (cf. [36] 1 


n-l 4 


{y, t) ■{y',t')= ?/ + y', + 2 ^ ^ Kjy4l+ky4i+j , 

\ ^=0 j,k=l j 

where s = 1,2,3, y = (yi,y 2 ,--- ,y4 n), y' = (y'i,2/2G-- ^VAn) ^ * = (^ 1 ,^ 2 ,is), t' = 

G K^. We denote 


(2.17) 


'^Al+j ■ — 


d 

dy4i+j 


3 4 


+ 2EE f^kjy4i+k 

s=l k=l 


A 

dts’ 


I = 0,... ,n — l, j = 1,4. They are left invariant vector fields on the quaternionic Heisenberg 
group Jf'”. 

The horizontal subspace Hq ■= span{Vi, ■ ■ ■ ,Yin} generates the corresponding Lie algebra of 
the quaternionic Heisenberg group. The standard M^-valued contact form of the group is 


(2.18) 


200 := dt - y ■ dy + dy ■ y. 


If we write ©o = (^ 0 ;i, ^ 0 ; 2 , 0O;3), then we have 

n—1 4 

(2.19) 26»o;s = dts - 2 ^ ^ bljyAi+kdy4i+j, s = 1,2, 3, 

;=0 j,k=i 

by using (j2.14p again. Then Ker0o = Hq. The standard Carnot-Caratheodory metric on the 
group is defined as 


9o{Yqi,Yp) — 25oij3, 

loT a, j3 = 1, • • • ,4n. We set Qo := {o-Ii + bl 2 + c/3|a2 + 52 + c2 = 1}, where transformations 
Is, s = 1, 2,3, on Hq are given by 

4 

IsY4l-\-k = ^ ^, ^jkX4l+j^ 
i=i 
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for / = 0, • • • , n — 1, /c = 1, 2,3,4. It is direct to check Ii,l 2 and Is satisfying the commutating 
relation of quaternions in (12.ip . Recall that the wedge product of 1-forms oji and UJ 2 is given by 

(2.20) (cui A lo2){X, Y) := loi{X)uj 2{Y) - u:i{Y)uj2{X), 

for any vector field X and Y. It is easy to see that 

n—1 4 

'j'dyia+k' ^ dy4.(i^ji (Yi^ii 

a=0 j',k'=l 


— ~‘^^kjdw — go{IsYAV+k^XAl+j), 

since V is antisymmetric. Thus, qq is compatible with ©q. So ( 70 ) Qo) is a qc manifold. 


2.3. The quaternionic hyperbolic space and the standard qc strncture on the sphere. 

The quaternionic projective space of dimension n -|- 1 is the set of left quaternionic lines 

in More precisely, 

jjpn+l _ (H«+ 2 \{ 0 })/ 

where ~ is the equivalent relation: {p[, ■ ■ ■ ,p(i_|_ 2 ) ig'ir-- ,qn+ 2 ) if there is a non-zero 

quaternion number A such that 

(Pl) ■ ■ ■ jPn+2) ■ ■ ■ ) ^Qn+2)- 

Let P : —)• be the canonical projection onto the quaternionic projective space. 

Under the induced action of Sp(n -(-1,1) on HP"”’'^, there are three invariant subsets 

P+ -{q’ GMP^+^;Q{q’,q’)>0}, 

Do :={q' GMP^+^-Q{q',q')=0}, 

D_ := {q’ G HP^+i; Q{q’, q’) < 0}. 

Then, as a homogeneous space for Sp(n -|- 1, 1), P+ is equivalent to the quaternionic hyperbolic 
space. In this case we must have qn +2 / 0. So a point in P_|_ is equivalent to (g, 1) for some 

q G e"+^ i.e. {C+ 2 q'l^ • • • > 9 n+^ 29 n+D I)' 

We introduce a positive definite hyperhermitian form on 

{q,p) := qipi ^ - V qn+ipn+i- 

It is obvious that U G Sp(n -|- 1) (cf. (|2.111) 1 if and only if {qU,pU) = {q,p) for any q,p £ 11"'+^. 
We have the ball model for quaternionic hyperbolic space: 

B^^+^ = {q£M^+^-,{q,q) <1}. 

Let 7 = {'jij) G Sp(n -(- 1, 1). 7 is a (n -(- 2) x (n -|- 2) matrix acts on left quaternionic vector 
space from right. For q G (g, 1) is a vector in The right action of 7 on this 

vector is denoted by (g, 1 ) 7 , whose l-th. component is 

n+l 

Kq, 1 ) 7 ]z := + 'y{n+2)i, l = ,n + 2. 


([( 9 , l)7]l, • • • , [{q, l)7]n-H2) ~ ([(g, l)7]n+2[(^> l)7]l, ' ' 


J(94)7]n+2[(^>l)7]n+l,l), 
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where [(g, l) 7 ]n +2 / 0 by 

|[(g, l)7]lp + • • • + ![((?, l)7]n+lp - I [(9, l)7]n+2p = 0, 

for q G So Sp(n + 1,1) induces an action on by 

(2.21) 7(g) := ([(g, l)7]n+2[(9, l)7]i, ''' , Hq, l)7]n+2[(9, l)7]n+i) for g G 

Sp(n + 1,1) also induces an action on in this way. 

The fundamental invariant on the unit ball is given by 

1 - (g,p) 


( 2 . 22 ) 

and 

(2.23) 


= 


(l-|g|2)2(l-|p|2). 


\{q,p)\ = cosh ( -d{q,p) 


for q,p & ^4n+4^ where d{q,p) is the quaternionic hyperbolic distance between g and p, which is 
invariant under the action of Sp(n + 1,1) (cf. p. 523 in [6]). 

For a H-valued function f = /i + / 2 i + /sj + / 4 k, we set 


4n+4 


di 


df : = ^ = dfi + df2i + d/sj + d/4k. 


1=1 


It is easy to see that for two H-valued function f and g, we have 

d(f • g) = df • g -b f • dg. 


In particular, we have dg = dxQ + dxi'i + dx 23 + dxsk if we write q = xq + xii + X 2 i + xsk. For 
a H”-valued function f = (fi, • • • , f„), we write df := (dfi, • • • , dfo). 

For a point C = (Cl, ''' ,Cn+i) G = {C G H"+i : |e| = l}, we consider a quaternionic 

subspace of the tangent space: 

:= {v G H”+^ : (u,C) = 0}. 

It is easy to see that dd^ is a left quaternionic subspace of H-dimension n. Then H = U^g 54 n+ 3 dd^ 
is the standard horizonal bundle of the tangent bundle of the sphere. Let 7 : [0,1] 5471+3 

be any smooth curve such that 7 ( 0 ) = C- We identify the vector ( 7 (( 0 ),--- , 7 (j_,_ 4 ( 0 )) with a 
tangential vector Xq = point C, if we write 7 ^( 0 ) = v^i-^ + v^i- 2 i + + v^k. 

The standard ImH-valued contact form on is given by 

n+l 

(2.24) ©s = E ^^0 > 

1=1 

where C = (Ci,-" ,Cn+i) G S'^"-+3. If we write 0 = X4«_3+ X4i_2i + X4/_ij-Fx4ik, / = l,...,n + l, 
and ©5 = ( 01 , 02 ,^ 3 ), then we have 

71 4 

ds = - 2 ^ ^ hljXii+kdxii+j, 

/=0 k^j=l 
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by using identity (12.141) again, and so 

n 4 

d0s = -2^ ^ bljdx^i+k ^dx4i+j. 

1=0 kj=l 

The transformation Ig on is given by left multiplying i^ : 

W(0)v ,??n+i(0)) I—^ ,i^77^+i(0)) . 

We can check that 

4 

(2.25) is (xi + X2i + xsj + x^k) = ^ b^jf^Xkij-i 

j,k=l 

(here io = 1) (cf. (2.2) in [SZ])- We define 

4 

'■= bjkdx^i+j, 

i=i 

for Z = 0, • • • , n — 1, j = 1, 2, 3,4, s = 1,2,3. Then for v € H(^, we have {IgvX) = 0) i-e- 
IgV G Qs = {all + 6/2 + c/sla^ + 6 ^ + = 1} is a Sp(n)Sp(l)-structure on H. Denote by 

gs the restriction to the horizontal subspace H of the Euclidean metric on multiplying 

a factor 4. We can prove that gs is compatible to ©5 and Qs on 5'4"'+3 as in the case of the 
quaternionic Heisenberg group, i.e. for any X,Y & H, 

gs{IsX,Y) = des{X,Y), s = 1,2,3. 

The group of conformal qc transformations of consists of quaternionic fractional linear 

transformation Sp(n + 1, l)/center [T7]. We have the following qc Liouville type theorem. 

Theorem 2.2. (Qc Liouville type theorem) (cf. Theorem 8.5 in |17] 1 Every conformal 
qc transformation between open subsets of is the restriction of a global conformal qc 

transformation. 

We can identify with the boundary S of the Siegel domain in 

(2.26) S := {(g, qn+i) G x El : Re^n+i = kP}, 
by using the projection 

TT : S ^ 

{q,qn+i) I—^ ( 9 , kk - qn+i)- 

The Cayley transform is the map from the sphere minus the southern point to the 

quadratic hypersurface S dehned by 

F : ^ s, (C,Cn+i) ^ {q,qn+i), 

where 

(2.27) (7= (l + Cn+l)"^C, gn+l = (l + Cn+l)"Hl-Cn+l). 

Then we have the stereographic projection: 
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given by 


9 — (1 + Cn+l) ^C) 


1 + Cn+ip 


Proposition 2.1. (cf. p.l46 in [15]) The Cayley transform is a conformal qc diffeomorphism 
between with its standard qc contact structure Qq in f2.18\} and the sphere minus a point 

More precisely, 


with its standard qc contact structure Qs in ^ 
(2.29) F*Go = a 


Qs 


2\l + Cn+l? 


a. 


where a = is a unit quaternion. 


We have the following corollary. 


Corollary 2.1. Suppose that gs is the standard qc metric on and go is the standard qc 

metric on We have 


(2.30) 


F*go 


9S 

2|1 + Cn+lP 


where F is the stereographic projection defined by i2.28\) . 


Proof. Let I = {Ii, 12 , 13 ) be the standard qc structure on the group and F = (/(j/^jL^) be 
the standard qc structure on the sphere. Let Ug ■= go{Is-, •) = dOg, if we write ©o = {9i, O 2 , O3). 
Similarly, let ui'g := gsil'g-,-) = d9g, if we write ©5 = { 9 [, 92 , 9 '^). Consider the fundamental 
4-form 


n = wi A cui -|- 012 A W2 + 013 A UJ3, 

on the horizontal subspace Flo-p for a fixe point p € It is known that an element g G 

GL(4n,M) preserving Q if and only if 5 G Sp(n)Sp(l) (cf. Lemma 9.1 in | 3 T]), where Sp(n) = 
{A G Ogg{ 4 :n); Alg = IgA,s = 1 , 2 , 3 } and Sp(l) = {aih 4-02/2 + 03/3; of -|- o^ + 03 = 1 }. Here 
A G ©g(j(4n) means that A is orthogonal with respect to go on Ho-p. Similar result holds for H'. 

Write aQso = (• • • ,Ylk=i^jk9kr " )■ It follows from (I2.29P and direct calculation that 
F*ujj = \Ylk=i ^jk'^'k 2- forms on the horizontal subspace, where A = 2|T+|WiF’ 

F*n = 

Then A preserving Q implies F*A preserving H'. This is because 

n’{F*A{Xi),--- ,F*A{X^)) = X-^F*n{FC^[A{F,Xi)],--- , FC^[A{F,X^)]) 

= X-^n{A{F^Xi),--- ,A{F^X4)) 

= x-^n{F^Xi,--- ,F^X4) = n'{Xi,--- ,^ 4 ), 

where Xi, ■ ■ ■ , W 4 G Ho-p. Thus F*A is orthogonal with respect to gs if A is orthogonal with 
respect to go, and vise versa. But for any X,Y G Hs,p with = ||F*y||gQ, there exists 

an A G Ogp(//), such that F^Y = AF^X. Then we have 

migs = = ll^ll.s- 

This implies that F*go is conformal to gs, i.e. we can write F*go = pgs, for some p, > 0. 
Consequently, we have F*Vol|^p = Vol|^^ . 

















CONFORMAL QC GEOMETRY, SPHERICAL QC MANIFOLDS AND CONVEX COCOMPACT SUBGROUPS 13 


On the other hand, F*d6s\Hs = ^oid6'ga\Hs = Xgs{Is--,-)\Hs = AtDsliLs for s = 1,2, 3, where I = 
aFd, and Ig is also an almost complex structure compatible with gs- It follows that {F*d9s) = 

y 2 nQj 2 n i?*Vol|^^ = A^"’Vol|j:^^. So we must have ^ = A. The corollary is 

proved. □ 

Then by the transformation formula ()2.30p . we get the following corollary. 


Corollary 2.2. For any ^ 

(2.31) 


{q,t) G , we have 


R*9oI = 




[50 


D*go = r^go. 


Proof. Note that the Cayley transformation F maps {—(, —Cn+i) to 
(2.32) (-(1 - Cn+l)-^C, (1 - Cn+l)-^(l + Cn+l)) 

for (^,^„+i) G The reflection R in (12.1211 on the Heisenberg group induces a reflection 

R := 7r~^ o R o TT on the quadratic surface S in (I2.26p . It is direct to see that 

Ri~C^~Cn+l) = {—Qn+l^^ ^n+l) ~ RiQ^Qn+l), 


for {q,qn+i) = F{C,Cn+i) by (I2.27p . Then F o ip o F~^ = R, where (p is the qc isometric 
automorphism of given by (C,Cn+i) (~C)“Cn+i). Consequently, F o ip o F~^ = R. 

Then, by Corollary 12.11 we have 


R*go\^= {F-y oip* oF*go 


|1 + Cn+lP 
C ■ |l-Cn+lP 
by (12.271) . where = (C,Cn+i). The result follows. 


90 


kn+l|' 


j^ol^ - 


llell' 


790 


□ 


2.4. The conformal action of Sp(n + 1,1) on the sphere. Let us show the elements of 
Sp(n + 1,1) acting conformally on the sphere with the standard qc structure. We need to know 
the conformal factor explicitly. 


Proposition 2.2. Suppose that 7 G Sp(n + 1,1) and Qg is the standard contact form on 
Then we have 


(2.33) 

at point C G where 


7*0slc = A 


0 s 

l[(C,l)7]n+2P 


A 


(2.34) 

is a unit quaternion. 


. ^ [(C, l)7]n+2 

|[(C,i)7U2| 


Proof. Note that for any x G H, 

(2.35) d{x~^) = — 

\xp 

By the action of Sp(n + 1,1) on the ball in (I2.2ip . we have 

n+l 

•^[(C, 1)7]; = = [(ciC, 0 ) 7 ]z, 

m=l 
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for ( G / = 1, • • • , n + 1, where dC = (d^i, ■ ■ ■ , d(n+i}- We differentiate (|2.2ip to get 

dj(C) = 


[(C, l)7]n+2 [(dC, 0)7]n+2 [(C, l)7]n+2 


l[(C,l)7]n+2|- 


[(C, ^h]l + [(C, l)7]n+2[K, 0)7]z, 


We find that -f{C)i = [(C, ^h]i • [(C, l) 7 ]n +2 and 
(2.36) 

n+1 

1=1 

n+l 


n+1 


=A- 


S ![(«• + [(«• 1A172 E l(‘'C.»)7l4(C, i)7li ■ [(C, i)7|72 

^>''1^2 E K'**;' »)7lil(7i)i7 ■ [(C. I)7l72 

ESGoo , 


rA. 


l[(C,l)7l„+2P 

by 7 preserving the hyperhermitian form Q{-,-) in (jl.ip . i.e., 

n+l 

(2.37) - ^ [(C, l)7]a(C',l)7]i + [(C, l)7]n+2[(C',l)7]n+2 = -CC' + 1 

l=l 

with C = (^' in the third identity and |(Cp = 1. The last identity follows from differentiating 
(I2.37P with respect to C and setting C' = (" to get 

n+l n+l 

[(+>0)7]«[(C, 1)7]« - [(+,0)7]n+2[(C,l)7]n+2 = ^dOO- 


1=1 


1=1 


Then (|2.36l) minus its conjugate gives 

n+2 

E 


iliOi - liOid-fiOi) = A 


0 s 


1=1 


|[(C,i)7U2P 


A. 


The proposition is proved. 


□ 


Let Xq be the tangential vector given by differentiating along a curve ? 7 (t) = {r]i{t),--- ,r]n+i{t)) 
at point C- Then the tangential vector 7 *Xo at point 7 (C) is given by differentiating along the 


curve 7 (r/(t)), i.e. ( 7 (f/(i))i, 

d_ 
dt 


(2.38) 


ft\t=o^(d{t))n+i), where 


= [(C, l)7]n+2[(d'(0), 0 ) 7 ]^ - + • [(C, l)7]z 


t=0 


by the definition (| 2 . 21 l) . Here 


(2.39) 


dt 


[ivit)Ah]nl2 = 


t=0 


[(C, l)7]n+2[(r?X0),0)7]n+2[(C,l)7]n+2 
l[(C,l)7]n+2|^ 


by (ICTl . 

The following proposition gives us the conformal factor of the transformation of Sp(n + 1,1) 
on the sphere with the standard qc metric. 
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1 


Proposition 2.3. For 7 E Sp(n + 1,1), we have 

(2.40) and j*gs = 

Proof. Let 7 be a curve in with 7 ( 0 ) = C such that 7 ^( 0 ) is horizontal. By 7 preserving 

the hyper her mitian form in (I2.37P again, we have 

n +1 

(2.41) - [( 7 (t), 1 ) 7 ]; [( 7 ( 5 ), 1 ) 7 ]/ + [( 7 (t), l)7]n+2[(7('S), l) 7 ]n +2 = -{ri{t),ri{s)) + 1. 

1=1 

Differentiate it with respect to t at 0 and then let s —>■ 0 to get 

n+l 

(2.42) - ^ [(7'(0),0)7]z[(C,1)7]; + [(7'(0), 0)7]n+2[(C, l)7]n+2 = -(7'(0), C) = 0 

i=i 

by 7 ^ 0 ) E H^. Then we have 


\ dt 


t=o 


n+l 


.7(0 ) = E (1(0 1)7117 ■ [('/(0),0)7l, - Tie ■ |(c, l)7li) l(C. l)7li ■ [(C, l) 7 l 72 = 0. 


1 = 1 


by (I2.38p . (I2.42P and 

n+l 


(2.43) [(C, l)7]i[(C, l)7]i • [(C,l)7]n+2 = ' [(C,l)7]n+2 = [(C,l)7]n+2 • [(7'(0),0)7]n+2 


1=1 


by (I2.37P and (|2.39l) . It implies that £ -^ 7 (C)- Thus 7 * 77 ^ C They actually 

coincide since 7 is invertible. Denote ||7f|p := gs{X,X) for X G H. Moreover, by (|2.38l) and 
(j2.42li again we have 


n+l 

jII7aii" = E 


1=1 
n+l 




t=0 


2 n+l 


Ell(Ol)7l72l('?'(0),0)7l,| 


i=l 

n+l 


+ E IAKC. I)7l7 - 2Re E IK. I)7l72[(7'(0), 0)7], ■ [(C. l)7li ' + 


i = l 


i = l 


l[(C 

Here we have used 


Er7i[(>/(o),o)7i,ri,,. ,2 jD/(o).o)7i„+2ri Eri'i7;(o)|i 

.1)7W2P LIKO 1)711 -2- 


|[(C,i)7|„+2P |[{C,1)7|„+2P' 


n+l 


n+l 


X] |[(^'(®)’®)^M - |[(^'(0)>0)7]n+2| ’ 

1=1 1=1 

which follows from differentiating (I2.4ip with respect to s and t at 0. Then by 7 * 75 ( 779 ,Xq) = 
75 ( 7 * 779 , 7 *77o), we complete the proof of (|2.40l) . □ 

Now we give the pull back formula of the quaternionic structure I in the following proposition. 

Corollary 2.3. For 7 E Sp(n + 1,1), we have 

7*1 = AIA, 

where X is a unit quaternion given by ^2.34^. 
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Proof. It follows from ()2.4p in the proof of Proposition 12.21 


□ 


2.5. Spherical qc manifolds and connected sums. A local sphere theorem was proved 
by Ivanov and Vassilev in [13], i.e. a qc manifold is spherical if and only if its conformal qc 
curvature of the Biquard connection vanishes. See also [Tj for a proof using parabolic geometry. 
The following proposition tells us that this definition coincides with the topological definition 
gives at the beginning of this paper. 


Proposition 2.4. A qc manifold (M, Q) is spherical if and only if it is a manifold with 
coordinate charts {{Ui,4>i)}, where cfi ■ Ui ^ 5471+3 transition maps are given by induced 
action of elements of Sp(n + 1,1). 


Proof. The necessity follows from the qc Liouville type Theorem 12.21 

Given such coordinate charts {{Ui,4>i)} of M, let us construct a qc metric g and a bundle 
Q on M. Let Xi be a unit partition subordinating to the cover {Ui}, i.e. suppxi C Ui and 
YhiXi = 1- Let g := YlkXkf’kds be a Carnot-Caratheodory metric on Hp = (j)*P[^.(^p^, where 
L the horizontal subspace of the sphere at the point (j)i{p). This definition of Hp is 
independent of the choice of i, since {4>ji)^H^.(^p-^ = H^.(^p-^ by Proposition 12.31 where transition 
map 4>ji := (fj ° £ Sp(n + 1,1). Then on the open set (fi{Ui) C we have 


9= y* ^kf'lgs ■9s + '^Xkof)i^ ■ f'hgs = Bgs 

\ k / k^i 

for some positive function B on 4>i(Ui) by the pull back formula (|2.4U|) for the metric gs in 
Proposition 12.31 Therefore (7 is a spherical qc metric on M. By Proposition 12.31 we have 


cj)Xf = i/fii with 1^(0 


[(C) l)C’i*]n+2 
I [(C) l)C’ii]n+2| 


on Ui n Uj. We have 4>*i{T) = I and (flj o = 4>kii^)- Namely (/)*j satisfy the cocycle condition 

and define a sphere bundle. We can choose Q = 4>* {BQs) locally, and the compatibility condition 
(I2.2p - (l2.3p for g and 0 obviously holds, since dQ = (j)*{BdQs) when restricted to the horizontal 
subspace. □ 


For ^ and e > 0, define a ball on the quaternionic Heisenberg group as 

^jr(C, e) := {g G IIC"^ • g\\ < e}- 

Let {M,g,Q) be a spherical qc manifold of dimension 4n + 3 with two punctures or 

disjoint union of two connected spherical qc manifolds {M(^ix g[i),Q[i)), (Af( 2 ), 5 '( 2 ))Q( 2 )) with 
one puncture rji € M(^i-^,i = 1,2, each. Let Ui and U 2 be two disjoint neighborhoods of rji and 
r] 2 , respectively. Let 

(2.44) fji-.U^ B,^{0,2), i = l,2, 

be local coordinate charts such that ifi{gi) = 0. For t < 1, define 

Ui{t, 1) -. = {g eUiU < \\'4’i{g)\\ < 1}) 

Ui{t) : = {?? G Up, ||i/>i(r7)|| < t}, 
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i = 1,2. For any t G (0,1), ^ G Sp(n) and a G Sp(l), we can form a new spherical qc manifold 
Mt^a,A by removing the closed balls Ui{t),i = 1,2, and gluing Ui{t,l) with U 2 {t,l) by the 
conformal qc mapping '■ Ui{t, 1 ) ^ U 2 {t, 1 ) defined by 

(2.45) ^t,^^Ai'n) ='^1^2^ ° Dto Ro a o Ao'ijji{r}), for r/G 17i(t, 1), 

where -R : {C G < ||C|| < 1} —>■ {C £ 1 < ||C|| < j} is the inversion in (|2.12l] . Note 

that 'ilt,a,A is conformal qc with respect to the spherical qc structure Q on M, since DtoRoaoU a 
is a qc automorphism of the quaternionic Heisenberg group. Such a conformal qc transformation 
maps Ui{t, 1) to U 2 {t, 1), which identifies the inner boundary of Ui{t, 1) with the outer boundary 
U 2 {t, 1) and vise versa. Let 

(2.46) U (M 2 \L^) ^ 

be a canonical projection. We call Mt^a,A the connected sum of Mi and M 2 , which is a spherical 
qc manifold by Proposition l2.4[ We denote this spherical qc manifold by {Mt^a,A,g, Qt,(T,A), where 
5 is a metric in the conformal class given by Proposition 12.41 As in the locally conformally case, 
the connected sums are expected to be not isomorphic for some different choices of t,a,A |19] . 
As in the locally conformally flat case, it is interesting to investigate their moduli space. 

3. The qc Yamabe operator and its Green function 

3.1. The qc Yamabe operator. On a qc manifold let us choose a local basis 

of the horizontal subspace H as in [36]. We choose a local section ei of H such 
that 5 '(ei,ei) = 1. Then, ei, Rei, l 2 ei, I^ei are mutually orthonormal. Set Iq = id\H- Now 
choose a local section 62 of H orthonormal to span{/fcei|A: = 0, • • • ,3}. Then 62 , 1162 , 1262)^362 
are mutually orthonormal again and span{Ikei\k = 0, • • • ,3} T span{/fc 62 |fe = 0, • • • ,3}. Re¬ 
peating this procedure, we can find 61 , • • • , 6 ^, such that {Ikej\j = 1, • • • , n, /c = 0, • • • , 3} is a 
local orthonormal basis of H under the metric g. Set 

Xil+a+l '■= V 21 aei +1 
for I = 0, ■ ■ ■ ,n — 1, a = 0, • • • ,3. Then 

g{Xj,Xk) = 25jk. 

The Carnot-Caratheodory metric g induces a dual metric on H*, denoted by Since the 

Biquard connection V preserves H, we can write the covariant derivative as XxjX^ = 

By definition, (Xxui)Y = Vx(<v(Y)) — <v(VxY) for a 1-form oj G Then we define an 

inner product (•, ■)g,Q on T{H*) by 

{UJ,UJ )g-,Q 1 = / {to, to )gdVg^Q, 

Jm 

where the volume form dVg^Q is 

(3.1) :=0iA02A03A(d0,)2’^, 

s = 1,2,3, if we choose 0 = { 01 , 62 , 03 ) locally. The volume form is independent of s and the 
choice of 0 by the follow proposition. 

Proposition 3.1. The volume element dVg^Q only depends on g and Q, not on s or the choice 
of the 1 ^^-valued contact form 0 = { 61 , 02 , 03 ). 
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Proof. Let 1-forms be the basis dual to Recall the structure equation (3.6) in 

[3B], i.e. 

n—1 4 

d9s = - EE A mod 01,92,03, 

1=0 j,k=l 

s = 1, 2, 3, where 6® is given by (|2.15ll . By using in (I2.15D . it is direct to check that 

/n—l \ 

{d9if^ = 29^^+^ A A 9^^+^ = 22^(2n)!0^ A • • • A 9^^^, mod 9i,92,9^- 

Similarly, 

(3.2) {d9sf'^ = 2^'^{2n)\9^ ^9^^, mod 0i,02,^'s, 

s = 2,3, and so dlg,Q is independent of s. Let 0 = (0i, 02,03) be another contact form satis¬ 
fying d9s{X,Y) = g{IsX,Y). We can write 9s = Yl^j=i^sj9j',s = 1,2,3, for some SO(3)-valued 
function (cjj) by Lemma 12.11 and simultaneously Is = Ylij=i^sjlj,s = 1,2,3, by the proof of 
Lemma [2.11 As the procedure at the beginning of this section, we can choose orthonormal basis 
{• • • , ek,hek,l 2 ek, h^k, ■■■}■ Then we have 

3 

Xil+l = Xiiij^i, X/^ij^a+l = V^Ia^l+l = Ca^X4;_|_^_|_i 

0=1 

for I = 0, ■ ■ ■ ,n — 1, a = 1, 2,3. Dually, we have the dual basis {0*} such that 

gil+l ^ 0il+a+l ^ 

0=1 

for / = 0, • • • , n — 1, a = 1,2, 3. In fact, we have 0^*+^ A • • • A 0"^^+"^ = det(cjj)0^^+^ A • • • A 9^^+^ 
and det(cij) = 1 by (cij) E SO(3). By (13.21) . we have 

dVg^Q = 01 A 02 A 03 A (d0s)^” = 22”(2n)!det(cy)0i A 02 A 03 A 0^ A ••• A 0^” 

= 22^(2n)!0i A 02 A 03 A 0^ A ••• A 0^” = 01 A 02 A 03 A {d9sf^. 

The proposition is proved. □ 


(3.3) 


Denote db := pro d, where pr is the projection from T*M to H* . We define the SubLaplacian 
Xg^Q associated to the qc contact structure (M, g, Q) by 

(3.4) / Ag^QU ■ vdVg^Q = / {dbU, dbv)gdVg^q 

JM Jm 

for u,v £ C^{M). The SubLaplacian has the following expression. 

Proposition 3.2. (cf. p.365 in [36]) For u E C°°{M), we have 


(3.5) 


^ 4n / 4n 

= 9 ( “"TjXjtt -I- Yj Tfcfc-Tj 


1=1 


k=l 


The transformation law of the scalar curvature under the conformal changes was given by 
Biquard in [3] for dimM > 7. When dimM = 7, it was given by Duchemin in [Tj. 






CONFORMAL QC GEOMETRY, SPHERICAL QC MANIFOLDS AND CONVEX COCOMPACT SUBGROUPS 19 

Theorem 3.1. Under the conformal change g = f^g, the scalar curvature becomes 

^g,Q = (® 9 ,Q “ 8 (n + 2)Tr^Va - 16(n + l)(n + 2)|ap) 

where a = f~^df and V is the Biquard connection. 

Writing the conformal factor / as e^, we can write the transformation law in the following 
form. 

Corollary 3.1. The scalar curvature associated with the structure g = e^^g satisfies 

+ 2(Q + 2)A,„h - £ W + 

Proof. Since / = e^, a = dh. Then, 



4n 


4ri. 


Tr^Va = = - Y,{Vx,dh){Xfi 


i=i 

An 


..An ..An / An 

- (Xj(dh{X,)) - dh{Xx,Xs)) = E V Aft - E h.A'* 


— Ag^qh. 


i=i 


k=l 


The result follows. 


□ 


Corollary 3.2. (cf. p. 360 in [SS]) The scalar curvature Sg^Q associated with the structure 

4 

{M,g,Q) with g = fiQ-^g satisfies qc Yamabe equation: 


(3.6) 


bnAg^Of) -|- Sg^QCj) 



Q 2 
Q-2' 


Now let us derive the transformation law of the qc Yamabe operator. See [28] for such 
derivation in the pseudoRiemannian case and |34j in the CR case. 

4 

Proposition 3.3. Let {M,g,Q) and {M,g,Q) be two qc manifolds. Let g = fiQ-^g for some 
positive smooth function on M. Then 

Q+2 

(3-7) Ag^qifi • /) = Ag^qf ■ f + A-g^qf 


for any smooth function f on M. 

Proof. Let 0 = (0i, 02, ^ 3 ) be a M^-valued 1-form associated to (M, g, Q) and let 0 = (0i, 02, 03 ) 
be associated to {M,g,Q). For any real function h on M, we have 

{Ag,qi4> ■ f), h)g,q = / {db{<p ■ /), dbh)gdVg^q = {dbfi ■ f -|- fidbf, dbh)g^q 
J M 

f * dbhfjg^q “1- {dbf., (p * dbfi)g^q 
= {dbfi, dbif ■ h))g^q -h {dbf, (p-dbh-h - dbffig^q 
— {Ag^qfi, f • h^g,q Y {dbf, ■ dbh h ■ db(f>)g^q. 


(3.8) 
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Let US calculate the second term in the right side of (13.8p . By our assumption and Proposition 


EH we just need to consider 0 = 0. Then for a fixed s, we have 

(3.9) 


dOs = d{(pQ-^6s) = ^ 4>Q-^d<j) A9 s + (pQ-^d6s, 


i.e. d9s = (i)'^-‘^d9s mod 01 , 6 * 2 , 03 . So, we get 

_ ~ „ 2 Q „ 2 Q 

(3.10) = 0, A 02 A 03 A {d9sf^ = <t)^9i A 02 A 03 A {d9if'^ = (p^dVg,^ 

Consequently, for 1-forms uJi,uJ 2 G r(iL*), we have 

(t<;i,a;2)g,Q= / (wi,W2)gdVg,Q = a;2)g,Q- 


' M 


Now we find that 


{dbf, (j)- dbh-h- db4>)g,Q_ = {4> dbf, (j) ■ dbh - h ■ db(f))g^Q = {dbf, dbi4> h))g^ 


= / A, 


1 f S±2 

■ (j) ^hdVg^Q= / (l)Q-^Ag^Qf ■ hdVg^ll^ 


The proposition is proved. 

Corollary 3.3. The qc Yamabe operator Lg^Q satisfies the transformation law 
(3.11) 

if 9 = 4>'^9 / G C°°{M). 

Proof. By using (|3.6p and (|3.7p . we have 


Q+2 

^g,Qf = 4> 


Lr^ 


The result follows. 


— b-aAg 


+ Sn 


= A 


n I 


Q+2 \ 

/ + Ag^l^fj + Sg^ 


Q + 2 

= {bnAg^qf + Sg^ 


□ 


□ 


3.2. The Green function of the qc Yamabe operator. For simplicity we write Gg^^Q, A^^ q, 
i'^')go,Q ^Oj Aq, Lq, {■,-)o- Since the Biquard connection on is trivial [15], its 
connections and curvatures vanish. For u G we have 

4n ^ D 

du = Y,Y,u-e> + Y^ft-s„,. 

j=l S=1 ^ 

and dbU = X)j=i ' + > where 9^ = dyj, and Yj is given by (|2.17p . Recall that (Y)-, Yfc)o = 25jk 
and {9fi 9^)o = ^5jk for j,k = 1, ■ ■ ■ , 4n. Hence, 

^ 4n 

{dbU, dbv)o = 2 X] 
i=i 

for real functions u, v, and the SubLaplacian is 


Ao = — 


1 

2 


4n 




by (l33p . 
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A continuous function Gg^Q : M x M\diagM —)• M is called the Green function of the qc 
Yamabe operator Lg^Q if 

/ Gg^qi^, r])Lg^Qu{r])dVg^Q{r]) = u{C) 

Jm 

for all u G G^{M). Namely, Lg^qGg^q{^, •) = 5^. 

In |22] Kaplan found the explicit form of the fundamental solution of the SubLaplacian on 
groups of H-type. Since the quaternionic Heisenberg groups is a group of H-type, we know its 
fundamental solution. 

Proposition 3.4. The Green function of the qc Yamabe operator Lq = on the quaternionic 
Heisenberg group with the pole at f is 

Go{^,v) ■= 

for f rj, where || • || is the norm on defined by \2. 7| j and 

(3.12) C«- = 8(„ + 1)(„ + 2)K 

where dV^ is Lebesgue measure. 

In the Appendix, we prove this proposition by simple and direct calculation. 

Proposition 3.5. Let {M,g,Q) be a connected compact qc manifold. Then one and only one 
of the following cases holds: there is a qc metric g conformal to g which have either positive, 
negative or vanishing scalar curvature everywhere. 

Proof. The qc Yamabe operator Lg^q is a formally self-adjoint and subelliptic differential oper¬ 
ator. So its spectrum is real and bounded from below. Let Ai be the first eigenvalue of Lg^q 
and let (f be an eigenfunction of Lg^q with eigenvalue Ai. Then f > 0 and is G°° by Theorem 
3.6 in HZ]. The scalar curvature of {M,g,Q) with g = cpQ-^g is Sg^q = Xif by the qc 
Yamabe equation (13.611 . In particular, Sg^q > 0 (resp. Sg^q < 0, resp. Sg^q = 0) if Ai > 0 (resp. 
Ai < 0, resp. Ai =0). On the other hand, if g has scalar curvature Sg^q > 0 (resp. Sg^q < 0, 
resp. Sg^q = 0), the first eigenvalue Ai of L^ q obviously satisfies Ai > 0 (resp. Ai < 0, resp. 
Ai = 0). □ 

Remark 3.1. This proposition does not exclude the possibility that a scalar positive qc manifold 
has a metric with scalar curvature vanishing or negative somewhere. 

Define the qc Yamabe invariant 


where |Vg/p = Ylj=i i^j} ^ local orthogonal basis of H under the Carnot- 

Caratheodory metric g. It is an invariant for the conformal class of qc manifolds (cf. p. 361 in 

[SB]). 

Theorem 1.1 in |36| tells us that, if X{M,g,Q) < X{Jff'^, go,Qo), then ()3.13ll can be achieved 
by a positive G°° solution u of the qc Yamabe equation (13.6p . i.e. it has a constant scalar 


(3.13) 


X{M,g, 


:= inf 

ii>0 


Im 


dVg^q 
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curvature SgQ = X{M,g,Q) for g = uQ-^g. It is known that go,Qo) > 0 (cf. Corollary 

2.1 US]). Thus, {M,g,Q) is scalar negative or zero if and only if X{M,g,Q) is negative or zero, 
respectively. Consequently, {M,g,Q) is scalar positive if and only if X{M,g,Q) is positive. 

From now on in this section, we assume (M, g, Q) to be connected, compact and scalar positive. 
In this case, the qc Yamabe operator Lg^q = bn^g,Q + is a positive operator and its inverse 
always exists. The Green function is the Schwarz kernel of the inverse operator and can be 
constructed as in the following proposition. Moreover, we also find the singular part of the 
Green function. In this case, the Green function of the qc Yamabe operator Lg^q is unique. 


Proposition 3.6. Let (M, g, Q) be a connected compact spherical qc manifold with positive scalar 
curvature and let U be a sufficiently small open set. Then the function Gg^q{^,rj) — Pg^q{f,,rj) 
can be extended to a C°° function on U x U, where Pg,qi-, •) is given by 

4 

Proof. The proof is similar to the CR case. Suppose that U C U C and g = f^-^go on U. 
We choose a sufficiently small p such that B^{f^,p) C U for any G U. We can construct the 
Green function as follows. For f^,ri G U, define 


G{^,v)=G{r^v), 

where G is the cut-off fundamental solution, i.e. G{fj) = y fiv) for fj G Here 

/ G G^{J^'^) satisfying / = 1 on and / = 0 on B^{0,pY. Recall that Lq = 

— ^ ^'^5 where Yj are given by (I2.17D . Then, 


(3.14) 


LoG{g) =Lo 




Vll^ll'^ 2 

=:do + Giifi) 


-/(« I = * - E r, ( Vim ) 

i=i 


V||r?||'3- 


+ irS^Lofig) 


by \\^\Q -2 being the fundamental solution of Lq and Yjf = 0 on ^). Here do is the Dirac 

function at the origin with respect to the measure dVo and Gi is defined by the last equality in 
(I3.14p . Set Gi{^,g) := Gi{f,~^g) for gU. Then, Gi{f,,g) G G°°{U x U) and for each ^ GU, 
Gi{^, ■) can be naturally extended to a smooth function on M satisfying Gi(^, r/) = 0 for t/ ^ U. 
By transformation law (13.lip and left invariance of Yj , we hnd that 

^5,Q(</'(0"V(-)"'G(e, •)) = 0(O"V(-)"^ioG(e, •) = </>(0"V(-)"^(5o(r'-)+Gipe, •)) 

= (l5 + ())(0-V(-)"^Gi(e,-), 

on [/ for ^ G 1/ , where 5^ is the Dirac function at point ^ with respect to the measure dVg^q = 

2Q 

(j)Q-^dVo. Now set 

(3.15) G{^,g) :=m~"m~^GiC,v) + G2iC,p) 


for g G M, where G 2 {f,,g) satisfies 

(3.16) ^3,qG' 2(^, •) = -<(>(e)-'</>(r^Gi(e, •). 

G 2 (^, •) exists since Lg^q is invertible in L‘^{M). G 2 (^, •) G G°°{M) for fixed f, G U by the 
subelliptic regularity of Lg^q. G 2 (-,r/) is also in G°°{U) by differentiating (|3.16l) with respect to 
the variable ^ repeatedly. Now we have Lg^qG{f^,-) = 5^, i.e. G{f,,g) is the Green function of 
Lg,q. By (|3.15p, Gg^q{f,,g) - Pg,qif,,g) G G°°{U x U). □ 
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We have the following transformation law of Green functions under the conformal qc trans¬ 
formation. 

Proposition 3.7. Let {M,g,Q) be a connected, compact, scalar positive spherical qc manifold 
and Gg^Q be the Green function of the qc Yamabe operator Lg^q. Then 

1 


(3.17) 




G9,Qitv) 


is the Green function of the qc Yamabe operator Lg^q for g = cfQ-'^g. 
Proof. By (13.101) and the transformation law (j3.1ip . we find that 


/ 

Jm 


Gg,Q{C,V)Lg,Qu{g) 1 




dVg,Q - 

1 


f 1 Q+2 2Q 

Im J^Gg^qi^, v)(f{v) 0-2 Lg^q{^u){g)(f{g) dVg^q 


m 


'M 


Gg,Q{^,v)Lg,q{(t>u){g)dVg^q = u(0 


□ 


for any u G G^{M). The proposition follows form the uniqueness of the Green function. 

4. An INVARIANT TENSOR ON A SCALAR POSITIVE SPHERICAL QC MANIFOLD 

4.1. A tensor invariant nnder conformal qc transformations. 

Theorem 4.1. Let (M, g,Q) be connected, compact, scalar positive, spherical qc manifold, which 
is not qc equivalent to the standard sphere. Define 


can{g, 




where q(^) is defined in (O if 9 = 4’^~^ 9o on a neighborhood U of Here go is the standard 
qc metric on . Then, can{g,Q) is well-defined and depends only on the conformal class [g] 
and Q. 

Proof. We will verify that Ag^q is independent of the choice of local coordinates and qg is 

4 

independent of the choice of g in the conformal class [ 5 ]. Suppose g = ^^-'^g. Let U C M he 
an open set and let p :[/—)• P C and p : U ^ V C be two coordinate charts such that 


9 = P 


"ffo I , 5 = P' 


4~"9e 


for two positive function and (/> 2 . Then, f = po p ^:14—>-t/isaqc diffeomorphism of 
by the qc Liouville type Theorem 12.21 and 

f* 9 o\^' = with 

for ff . We claim the following the transformation law of the Green function on the quater- 
nionic Heisenberg group under a conformal qc transformation: 

1 11 
^ MrW)F^ “ WW!^)' 

for any ff, g' G V. Apply this to = p{C),g' = p{g) and f = po p~^ to get 

1 111 


||p(0 ^p{9)\\^ ^ HpiO) 4>{p{p)) \\p{0 ^pivW 


-2 
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and so 


= lim 


= lim 


Cq 


Gg,Qi^,v) ^2(p(^))^2(p(r?)) ■ 

Gg,Q{^,'n) 1 Cq 


1 

Q-2 


1 Cq 


= $ Q-2 lim 


Cg,Qi^,V) - 


Q-2 


Q-2 


Mpimiipiv)) MO-^PivW-^ 


= $ 0-2 (^)^g,Q(,^). 

Consequently, we have 


■^1,q9 - 


It remains to check gH). By qc Liouville type Theorem 12.21 / is a restriction to 1/ of a 
qc automorphism of denoted also by /. By the transformation law (I3.11j) . for functions 
(f> := (j)o f~^,u := uo f~^ on V, we have 

lo = Lg^Q To(u)|^,, 


L(] 


2Q 


(4.2) 

rdVo\f(^g,) = cl,^Hv ) dVo\^.. 

The first identity follows from the fact that the qc Yamabe operator is independent of the choice 
of coordinate charts. Then, by (14.2p and taking transformation f{r]') —)> fj, we find that for any 
u G 


I 


CQm^ip' 


CQm 


_ f CQ^ie) 


-i„- 


Lo{4> 


dVo{fi) = u{i'). 


ll/(^') ^^11® ^ 

Now by the uniqueness of the Green function of Lq, we find that 

r (f Yi = CQ 4 >{^) 4 >{rl) 

Thus, (14.ip follows. The theorem is proved. □ 

See [23] for the identity (BU) on the Euclidean space and see |33| on the Heisenberg group. 

Corollary 4.1. {M, can{g,Q),Q) is a spherical qc manifold if the qc positive mass conjecture 
is true. 

4 

Proof. Write g = 4>^-^go locally. Note that by Proposition 13.41 ITHI and [3171 we have 
Cg,Q{i,g)'^g = {/3g,Q(?,^) +2lg,Q(0 + 0(IIC"^^II)}^5 

V V 

= ■ (1 + /3(«)iir‘4ii«-" + odirNii®-')}’* » 


«(0 




for g near where 
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Now choose the conformal qc mapping := Ro Dr o r^-i on a neighborhood of ^ to as 
required in the qc positive mass conjecture, where r = . It is easy to see that C^{^) = oo 

and 




a,. 


,r])Q-2g 


= R*o DU otUG 


^9,' 


r])Q-^g 


4 

3-2 


= ( 1 + 

by Corollary 12.21 where fj = C^{g). The qc positive mass conjecture promises to be 

positive. So, is non-vanishing. □ 

Remark 4.1. Let {M,g,Q) and {M,g,Q) be two connected, compact, scalar positive spherical 
qc manifolds with dimM = dimM, which are both not qc equivalent to the standard sphere 
{S‘^'^^^,gs,Qs)- Suppose f : {M,g,Q) {M,g,Q) be a locally qc diffeomorphism. Then, 

f*can{g,Q){X,Y) > can{g,Q){X,Y), 

for any tangent vector X,Y G TM. This can be shown as in the CR case (cf. Proposition 3.4 
in [33]). 


4.2. Scalar positivity of the connected sum of two scalar positive spherical qc man¬ 
ifolds. Scalar positive spherical qc manifolds are abundant by the following proposition. 

Proposition 4.1. If t is sufficiently small, the connected sum {Mt^a,A, 9,Qt,(T,A) is scalar posi¬ 
tive. 

Proposition 14.11 follows from the following proposition. 

Proposition 4.2. If t is sufficiently small, we have X{Mt^a,A, g,Qt,(T,A) > 0. 

Proof. See |23j for the Riemannian case. We provide more details that are different from the 
Riemannian case, compared to the proof of the CR case in [33]. Let 

Mo = Mi\{ 6 } u M 2 \{ 6 }, 

and let 5 be a spherical qc metric on Mq. Then, by multiplying a positive function g G 
C'°°(M)\{^i,^ 2 }) we can assume g = gg satisfying 

= 1 ^ on Rjr( 0 , 2 )\{ 0 }, 

where fi : Ui ^ Bj^{0,2), i = 1,2, are coordinate charts in (|2.44l) . It is easy to see that 
gluing mapping 4tt,a,A in (|2.45p preserves the metric on t < IICII < j) 0 < < 1 ) by the 

transformation law and Corollary 12.21 pp is invariant under the rotation A, transformation 
a and the inversion R. Hence we can glue g by ^t,(T,A to obtain a spherical qc metric that 
coincides with g on Mi\Ui{t) U M 2 \U 2 {t). We denote the resulting qc metric also by g by abuse 
of notations. We denote the connected sum by {Mt, g,Qt). Here we omit the subscripts a and 
A for simplicity. The scalar curvature of g on 1)\{0} is 

(Q-2)(Q + 2) |y|2 


SgMiO = 

by (lA.Sp in Appendix. 


lien 


2 ’ 


for ^ = {y,t) G 
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(Mo, 5 , Q) has two cylindrical ends. We can identify the ball with cylindrical end by the 
mapping 

(/>: B(0,1) ^ [0,oo) X S" 


(4.3) 


? = D^-u{r]) 


'"M’M 


where S” = {ry G ||ry|| = 1} is diffeomorphic to the sphere 5^”'"’'^. Define a Carnot- 

Caratheodory metric 


9i« = (r'r ( 


iifii' 


on [0,oo) X S” and 0 = (01,^2,^ 3 ) is a compatible contact form. (5^(0,1)\{0}, |||p,Q) is qc 
equivalent to ([0,oo) x Since 

dVo 


i^iTdVg,Q = 




is invariant under rescaling, it is easy to see that the measure 9i A 62 A 9^ A {d9s)‘^^ is invariant 
under translation (u',^) -A (u' + uq,^} on [0,oo) x S"". As a measure, we have 

(4.4) 01 A 02 A 03 A (d9s)^^ = dudS-s^, 

where is a measure on S”. set 


/ = ln 


1 


and write 


(Mo, g, Q) = ([0, 00 ) X S'", g, Q) U (M, g, Q) U ([0, 00 ) x g, ( 


where M = M\{Ui{l) U 1 / 2 ( 1 )). We identify two pieces of (0,1) x S”,^,Q) to get {Mt,g,<- 
Denote by Uri the y-coordinate of ry G S”, i.e. we can write ry = (y/r^ji??) £ for some 


G M'*. Then, 


|Vgu| = 






(4.5) 

where ^ = (yg,t^) for some tg, and 

{Q-2){Q + 2). ,2 

(4-6) Sg^Q{u,g) = - - - 

by ()A.7I1 and (jA.Sp in the appendix. By the definition of the Yamabe invariant X{Mt, g,Qt), we 
can find a positive function fi G C°°{Mt) such that 


(4.7) 
and 

(4.8) 


[ (&n|Vg/;p + Sg^Qtfi) dVg^Q^ < X{Mt,g,Qt) + y, 

JMt ‘ 

/ 

JM 


2Q 

fl^-"dVg,Q, = 1 . 


Put Ai = — min { 0 , min^^^ Sg,Q} Vol(M) < 2 - 2 , which is uniformly bounded by Vol(M, g). Thus 
by using Holder’s inequality we get from (14.71) that 

[ + Sg^Qj/f) dttdS's" < X{Mt,g,Qt) + j + Ai, 

/[0,«]xS" ‘ 
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(cf. Lemma 6.2 in [23]). Note that Sg^Q^ is nonnegative on [0, oo) x S"" by (14.6p . Therefore, there 
exists Z* G [0, Z] such that 



Vg/ip + Sg^iQ^fi) cLSy,^ < 


9, Qt) + 1 + ^1 

Z 


i.e. we have the estimate 

(4.9) [ {\Vgfiik,r^)\^ + \yg\^fiik,r^)) dSMv) < 

by the scalar curvature of g in (|4.6p . where C is a constant independent of Z (because the 
qc Yamabe invariants X{Mt, g,^t) for t > 1 have a uniform upper bound by choosing a test 
function). It is different from the Riemannian case that the scalar curvature |^jp- is not constant. 
But it is still independent of the variable u. Now define a Lipschitz function T) on Mq by T) = fi 
on [0, Z*) X S"" U M U [0, Z — Z*) X S” and 


(4.10) 


Fi{u,x) = 


{k + I — u)fi{u,x) for (u, x) G [Z*, Z* + 1] X S"', 

0 for {u, x) G [Z* + 1, oo) X S"", 


where fi{u,x) = fi{h,x) and similarly on [Z — Z*,oo) x S”. 

By definition, |VgT)| = \Vgfi\ and = ff hold on [0, Z*) x S” U M U [0, Z — Z*) x YF. On the 
other hand, note that |VgF;| < |Vgu||/i| + |Vg//| pointwisely on (Z*,Z* + 1) x S” by definition. 
By (|4.5I) . (|4.6p and estimate (|4.9p . we find that 

[ {bn\^gFi\^ + Sg,QF^) dudS^n <c' f dudS^.{g) 

./(Z*,/*+l)xS'» 4(U,L+l)xS" ^ ^ 

<C'' [ {\^gflik,v)\^ + \yrj\^fhl*,9)) dS^n{g) < ^ 

by \Vgfi{u,g)\ = |Vg/;(Z*,7/)| < \^gfi{l*,'n)\ pointwisely, since horizontal subspace H and g are 
invariant under the translation {u,g) —)• {u + UQ,g) and fi is independent of u. Therefore, we get 



+ Sg^qF^^ dVg^Q < X{Mt, g, Qt) + 


B 

T’ 


for some constant B independent of Z. 

Obviously from (I4.8li and the definition of T), we get 



2Q 

Fl^-^dVg^Q > 1. 


Therefore, 


(4.11) 


. , Imo NVgFl^+Sg,Q) dVg,Q ^ 

inf—^-QZi- < X(Mt,g,Qt) + 

-T >U 


Mo 


2Q 

FQ-^dVn 


Q-2 

Q 


I ’ 


where the infimum is taken over all nonnegative Lipshitz functions with compact support. It 
follows from the definition of the Yamabe invariant that the left side is greater than or equal to 
X{M, g,Q). If {M,g,Q) is a disjoint union of {Mi,gi,Q) and {M 2 , g 2 ,Q), we have 


(4.12) X{M,g,Q) = min{X{Mi, gi,Q), X{M 2 , g 2 ,Q)}, 

by the definition of the qc Yamabe invariant. Prom (14.lip and (j4.12p . X{Mt, g,Qt) is positive if 
Z is sufficiently large, i.e. t is sufficiently small. We complete the proof. □ 
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5. The convex cocompact discrete subgroups of Sp(n + 1,1) 

5.1. Convex cocompact subgroups of Sp(n + 1,1). A group G is called discrete if the 
topology on G is the discrete topology. We say that G acts discontinuously on a space X at 
point q if there is a neighborhood U of q, such that g{U) n C/ = 0 for all but finitely many g G G. 

Let r be a discrete subgroup of Sp(n + 1,1). Choose q G define the limit set of L 

by 

A(r) :=T^n5^"+3, 


where Lg is the closure of the orbit of q under L. It is known that A(r) does not depend on the 
choice of g G (cf. Proposition 1.4 and Proposition 2.9 in M)- The limit set A(r) of all 

limit points is closed and invariant under P. The radial limit set of P is 


< 00,7 ^ ^ I ’ 

where refers to the point on the ray from 0 to ^ for which d{0,^T) = T and d(-, •) is the 
quaternionic hyperbolic distance. 


A'-(r) := u G A(r) 


lim inf d(^T, 7 ( 0 )) 
r->oo 


n{T) := 


is the maximal domain in on which P acts properly discontinuously by Proposition 8.5 in 

[9]. r is called a Kleinian group if n(r) is non empty. A Kleinian group is called elementary if 
A(r) contains at most two points. The Kleinian manifold associated to P is defined to be 

Mr = (s^”+^ufi(r))/r. 


It is know that n(r)/r is a smooth manifold and Mr is a manifold with boundary (cf. the 
proof of Corollary 11.11 in [S]). P is called convex cocompact if Mr is a compact manifold with 
boundary. In this case, II(r)/r is a compact smooth manifold. 

Two basic properties of convex cocompact groups are given in the following proposition. 


Proposition 5.1. (cf. p. 528 in [^) Suppose that T is a convex cocompact group o/Sp(n + l, 1). 
Then, 

(i) The radial limit set coincides with the limit set. 

(a) Any small deformation of the inclusion i : P —>■ Sp(n + 1,1) maps P isomorphically to a 
convex cocompact group. 


An interesting class of convex cocompact groups can be obtained as follows. For a convex 
cocompact group P in Sp(n + 1,1), there is a large family of infinitesimal deformations of P and 
these are all unobstructed. The small deformations give convex cocompact groups by (ii) above. 

Let {Gi,G'j}\^^ be the boundary of mutually disjoint balls {Di, where Di = 

and D[ = for some points G r^, r' > 0, i = 1, - ■ ■ ,k. There always exist 

group elements 7 ^ G Sp(n + 1,1) such that 

+(^”\A) = A 

(the “dilations” with the origin and infinity played by the centers of balls Di and respec¬ 
tively). Then {ji} generates a convex cocompact subgroup P which is isomorphic to the free 
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group of rank k. As in the Riemannian case , we call such group the Schottky group. It is easy 
to see that {Di U D[) is the fundamental domain for F. n(r)/r is diffeomorphic to 

(5.1) k = {S^ X ^ 54n+2)^ 

U is the connected sum operation defined by (I2.46li . 

See also [ 2 ] for other interesting examples of convex cocompact groups. 

5.2. The Patterson-Sullivan measure. 


Theorem 5.1. (cf. p. 532 in [ 6 ]) For any convex cocompact Kleinian group T C Sp(n + 1,1), 
there exists a probability measure fir supported on A(r) such that 

(5.2) 7 >r = 

for any 7 G T, where | 7 '| is the conformal factor. 


See also |T0] and [33] for Patterson-Sullivan measure for the complex case. We need to 
know the explicit conformal factor | 7 '| for our purpose later. Fix a point q € the series 

converges for s > (5(F) for any p G ^4n+4^ diverges for any s < (5(F). Fix 
a reference point 0 G R4n+4_ recall the definition of Patterson-Sullivan measure in 

Define a family of measures as 


(5.3) 


• — 


E 


7er 


„-is-ci(0,7(g)) 


where 6 .yfq) is the Dirac measure supported at point 7 ( 9 ). For each s > 5(F), this is a finite 
positive measure concentrated on Tq C Tq. The set of all probability measures on Ff^ is compact 
(cf. p. 532 in [B]), and so there is a sequence s, approaching 5(F) from above such that 
approaches a limit fj,s,p- After rewriting the coefficients, we may assume that the denominator 
in (|5.3p diverges at s = 5(F). Thus, we replace the above expression by 


(5,4) 


Fs,p — 


E 


7er 


-is-d( 0 , 7 (g)) 


with a-y’s so chosen that the denominator converges for s > 5(F) and diverges for s < 5(F). The 
denominator of this expression will be denoted by L(s, 0). The definition of the measure fig does 
not depend on p G R4n+4 ptioice of a.y (cf. p. 532 ISj). The Patterson-Sullivan measure 

is the weak limit of these measures: 

l^r,p= lim 

Since we use the right action of matrix, here 7 ~^( 7 ^(( 7 )) = ( 7 ^ 7 ~^)(q')- For any 7 G Sp(n -|- 1,1) 
and any / G C{B), we have 


{j*hsi,p){f) = 


L{si,0) 


L(sj,0) 

L{si,0) 


Msi,7-l(p)(/) 
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by the invariance of the quaternionic hyperbolic distance d{-, •) under the action of Sp(n + 1,1). 
It is easy to see that is also such sequence satisfying the definition for fixed 7 . Letting 

Si ^ we get 

7*hr,p = hr,7-i(p)- 

Recall that we have the following the Radon-Nikodym relation (cf. p.77, p.81 in |38ji: 


i(p) 






where Pp^^{q) is the Buseman function at ^ G ^(r) normalized such that Pp^^ip) = 0. It follows 
from the formula of Buseman function (cf. p. 81 in [38] 1. 

/ N _ 1 |1 - (P>7>)l|l - { q , 0 \^ 

|l-(g,g)||l-(p,e)P’ 


that 


dpr,'y~^(p) 


dpr,f 


|l - (7 ^(p),7 Hp))!" 


5{r) 


|1 - (p,p )|2 |1 - (7-i(p),0l 


for ^ G Then, for p = 0, we have 


7 - 1 ( 0 ) 


dpr,o 


= lim 


= lim 


= lim 


|l-(7~H0),7~^(0))P|l-(0, 
|l-(0,0)|i|l-(7-1(0),r/)| 


5(r) 


( 0 , 7 ) 


(7-1(0), r/) 


< 5 (r) 


1 - (7(^/),7(^)) 


= lim 

s(r) 


( 0 , 7 ) 


(0,7(?/)) 


5(r) 


1 


|[(e,l)7U2|^(i') 


1 - {p,p) 

by (|2.37p . where 7 G and !(•, •)! defined in (j2.22p - (l2.23l) is invariant under Sp(n + 1,1). So 

if we define pr ■= Pr,o, we get 

Then, we have 

Proposition 5.2. For any 7 G T, the conformal factor 


|7'(0I = 


1 


for G 5^’"+^ 


i[(e,i)7W2r 

Theorem 5.2. (cf. p. 533 in [ 6 ]) If T G Sp(n + 1,1) is a convex cocompact group which is 
not contained in any proper parabolic subgroup. Then the measure pr coinsides with (5(r)- 
dimensional Hausdorff measure concentrated on A(r), i.e. there exist constants Ci < C 2 and R 
such that if ^ G A(r) and r < R, then 

^ ^ priBriO) / ^ 

^1 ^ ^5(r) ^ ^2, 

where Br{C) is the ball in with radius r under the Carnot-Caratheodory distance dec- 

Here dcc{p,q) = inf-,, /q | 7 '(t)|dt for any p,q £ where 7 : [0,1] —>■ S'^’i+3 are Lipschitzian 

horizontal curves, i.e. 7 '(t) G H-yp) almost everywhere. 
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6. An INVARIANT QC METRIC OF NAYATANI TYPE 

When the spherical qc manifold is n(r)/r for some convex cocompact subgroup F of Sp(n + 
1,1), we can construct an invariant qc metric i^r, which is the qc generalization of Nayatani’s 
canonical metric in conformal geometry [26]. 

Define a function on D(r) by 

m)--= ([ Guc,c)dMc) 

\JA{r) 

4 

Set gr ■= 4>r~^9s- Since 

05(7(0,7(0) = i7'(or^i7'(or^o5(oo 

by the notation ly'l in Proposition 15.21 Proposition 12.31 and the transformation law of Green 
functions (|3.17p . we have 
( 6 . 1 ) 

Q-2 

( /* 2S(r) \ 25(r) / p 26(r) 

/ Gt" {l{0X)dMC) = / (7(0,7(0)d7Vr(0 

JAiT) J \JA{r) 

( V 

r 0-2 

/ l7'(0r''^^^O|-^ itOdMO = l7'(0r~</>r(0 

JA(r) J 

by using formula (15.211 . Therefore, m together with Proposition 12.31 and Proposition 15.21 
implies that 7*flT = gr- So it induces a spherical qc metric on D(r)/r. 

Theorem 6.1. Let T be a convex cocompact subgroup o/Sp(n + 1,1) such that A(r) ^ {point}. 
Then, if 5(r) < 2re + 2 (resp. (5(r) > 2n + 2, resp. (5(r) = 2n + 2), the scalar curvature of 
(D(r)/r, gr, Q) is positive (resp. negative, resp. zero) everywhere. 



2<5(r) 

Q-2' 


Proof. To calculate its scalar curvature, pull back the qc metric gr locally to the quaternionic 
Heisenberg group by the quaternionic Cayley transformation. Without loss of generality, we 
can assume that the southern point (0, • • • ,0, —1) of the sphere is contained in D(r). Let 

^ E D(r). Under the stereographic projection F defined by (|2.28|) . we have 


Q-2 / \ 

(6.2) G5(T-H0,i""'(O)= ' (-- 

V2|i+p„+iiv v2|i+K+ir/ 

by Corollary 12.II and Proposition 13.61 where {p,pn+i) = F“^(^), (p',p'„_,_i) = F“^(^') E 
Define the set A(r) and the measure /2r on by 


(6.3) 


A(r) := F(A(r)), ilriO 


,2|l+K+ir 


£(£) 

2 


{F-r^a 


and the metric on J^’^\A(r) by 


9r = {F-r9r- 


By the stereographic projection F, P induces an action on It follows that that the set A(r) 
and the metric on are both invariant under the action of P. 
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Now we begin to calculate its scalar curvature. Write gr\^ = {0so\^- with 


n(0 = 


Q-2 

1 \ 4 


2 |1 + Pn+l\ 


/ Gg(F-^(0,C)d^r(C) = / 

/A(r) / VJA(r) 


by using (16.2p , Corollary 12.11 and the definition of the measure gr in (|6.3I) . Denote 


gric := := Gq II? 


for E Then 




and the scalar curvature of qy is 


4n 


= 2(Q + 2)e-2/(«) I Ao/ - 

1=1 


by Corollary 13.11 Note that, 




/(?) = - / 

JA(r) 


where (/>r;(-) := (pi'iV) nnd the measure 


-1 


(6.4) 


di'{r]) : = 


/A(r) 


</>T?(?) dflriv) iOdiJ-riv) 


depends on where 6 := (5(r). Then, 


y^yj 


/(?) = - f ^YjYj(l)^du + (5 + 1 ) f {(/) du - <5 ( / ^Yjcf), 

Jk{r) Jk{r) \Jk{r) 


dv , 


and so 
(6.5) 


/A(r) 

An 


4> ^Ao(j)r,diy - 




(d+l) 


L 


An 

K‘^'^\yj(t^v?du 

m 


,=i 

Q (^ +1 

T 2 




(j) ^YjCprjdl' 


=1 VM^) 

An 




„ An An / „ \ 

/ ^n^'^\yj(t^v\^duj (l)-%cl)ydu 

'A(r) VHr) j 


1/ I 

4 JA(r) ^ JA(r) 


(j)y AQ(j)ydv, 
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by Aq = — ^ Ylj=i Direct calculation gives 


^o4^r] — 


G=-«AoGo- 


4n 


2-Q 


n 2 Q -2 


and 


4n 


Elu 


(2-(3)2 


2Q 


i=i 


jYr)\ 


i=i 


(2 - Q)2 


4n 

E ILGo 

i=i 


Moreover, AoGo(^, 77 ) = 0 for / r]. We see that the last two terms in (16.5h are canceled. Thus, 


~ 2((5 + 2) 


Q _ 2 / 


« 4n 4n 

A(r) 


/A(r) 


^Yjiprfdh' 


Let A = be the symmetric matrix with 


( 6 . 6 ) 


Ajk — 


/ 4>n ^Yj(j)r, ■ </>„ ^Yk(j)r^dl' - (j) ^Yj(l)r^du / 

iA(r) iA(r) iA(r) 


(l)^^YkCl)rjdu 


Note that for real number aj, j = 1, • • • ,4n, we have 


^ ^ Ajj^QjjCLj^ — / /i du I / 

■^A(r) Va 


/idu 


/A{r) 


with h = Y^^^iO-jft^n^Yjcf)^. So it is easy to see that A is non-negative by the Cauchy-Schwarz 
inequality and f]{(r) ~ ^(0 ^ 0- Then, 

(6.7) = 8(n -h 2) -h 1 - 0 e~'^^TrA{^). 

Hence, the result follows from the fact that TrA(^) is nowhere vanishing on H(r) by the following 
lemma. □ 


Lemma 6.1. IfTrA{^) vanishes at some point ^ E D(r) and d(r) ^ 2n + 2, then the limit set 
A(r) is exactly one point, and A vanishes identieally. 

The proof is exactly the same as that in the CR case (cf. Lemma 4.1 in [33]). 


Appendix A. The Green function of the qc Yamabe operator on the 

QUATERNIONIC HeISENBERG GROUP 

See also §2.4 in [T5| for a similar calculation for regular solutions of the qc Yamabe equation. 
Proof of Proposition Without loss of generality, we assume .^ = 0. Denote rj = {y,t). 


Recall that Aq = 

Wehave 

(A.l) 

y ( 1 \ Q-2 Y,l+M\" 

+ 4 (y|4 + ,2)^ 

with 

3 4 

(A.2) 

Yii+jWvf = 4|ypy4;+i + 4^^6|^-y4;+fcG, 


s=l k=l 
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by using the expression of the vector field h 4 /_|_j in (12.171) . Note that is an orthonormal 

basis. Then we get 


(A.3) Ao 
where 


Q-2 




Anllr ?||4 (Q + 2) |Vo| 


|4|2 


+ 




/I 9n‘5+6 

4 + e2 — 


n—1 4 


2|Vnllr?ll^l 


/=o i=l 

n-l 4 / 34 

leEE |!'I‘‘!'4T +E E b('jbijy4i+k'y4i+ktsts' ) = 16||7/||^|y|^ 

/=0 j=l \ s,s^=l k,k'=l 


(A.4) 


by using (IA.2h and Kjbfk' ~ ib^b^')kk', antisymmetry for b^b^' of s / s' and (6®)^ = —id. 

Similarly, by (|A.2D . we get 

(A.5) 


n-l 4 


3 4 


Anl|r?ll^ 


EE 8y|+j +4|y|2 + 8 EE bk' jbkjVil+k'yAl+k 1 — —2{Q + 2)|yp. 


1=0 j=l 


s=l k,k'=l 


Then apply ()A.4h and dAA]) to dS to get 

1 


(A.6) 


An 


{Q-2){Q + 2)\y\h^ 


4 +g2)V 


2 {\\yr+e^)^ 


Now letting e ^ 0, we see that for any u G 

Cq 


LqU ' 


R4n+3 ^|y|4 _j_ |^|2^ *^4 e^0jjf4n+3 ^|y14 _j_ |^12 _j_ g2 ^'^4 


= lim 


LqU ■ 


Cq 


Q-2 


= lim / 

e—>-0 Jj ^4 n +3 


u • CgbriAo 




= u(0) 


by (IA.6P and the formula (I3.12p for Cq . The proposition is proved. 


□ 


For g\^ = j^p) we can write g = 4>^~^go with (p = IICII • It follows from the transformation 
law of the scalar curvature (j3.6p that 


(A.7) 


Sg,Q = 4> ^-^^nAo(/> = f^nAollCII 

= |v„ii{iiT + ii{ir"J^A„ii«i|4 

(g- 2 )(Q + 2 ) |y |2 


2 II^P 

by (|A.4p and (|A.5I) . where g = {y,t). Similarly, we have 


(A.8) 


11 


= iiep 


Vn In 


1 

M 


16 IPP 


IVoPIlf = ^M 
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